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Abstract 

We observe deterministic chaos in a simple network of electronic logic gates that are not regulated 
by a clocking signal. The resulting power spectrum is ultra- wide-band, extending from dc to beyond 
2 GHz. The observed behavior is reproduced qualitatively using an autonomously updating Boolean 
model with signal propagation times that depend on the recent history of the gates and filtering 
of pulses of short duration, whose presence is confirmed experimentally. Electronic Boolean chaos 
may find application as an ultra-wide-band source of radio waves. 

PACS numbers: 89.75.Hc, 89.70.Hj, 02.30.Ks, 05.45.-a 



* RZ and HLDSC contributed equally to this article 



We show here that a very simple digital electronic device displays a form of deterministic 
chaos, a dynamical state characterized by a broadband spectrum and rapid divergence of 
nearby trajectories. We also show that a modeling framework based on Boolean state tran- 
sitions with update times determined by signal propagation explains the origin of this novel 
behavior, which we term "Boolean chaos." Our device may be used as a building block in 

n 

secure spread-spectrum communication systems [JJ, an inexpensive ultra- wide-band sensor 
or beacon, or a basis for engineering high-speed random number generators Qj. It can also 
be used to address fundamental aspects of the behavior of complex networks. 

Our network consists of three nodes realized with commercially- available, high-speed 
electronic logic gates. The temporal evolution of the voltage at any given point in the circuit 
has a non-repeating pattern with clear Boolean-like state transitions, displays exponential 
sensitivity to initial conditions, and has a broad power spectrum extending from dc to beyond 
2 GHz (see Fig. [T]). Because the circuit includes feedback loops with incommensurate time 
delays, it spontaneously evolves to dynamical states with the shortest possible pulse widths, 
a regime in which time-delay variations generate chaos. We conjecture that similar behavior 
will occur in a wide class of systems described by autonomous Boolean networks. 

Boolean networks have been studied extensively in a variety of contexts. For systems that 
display switch-like behavior, such as logic circuits and gene regulatory networks, it is often 
useful to assume the system variables take only two values (e. g., "high" and "low") that are 
updated according to specified Boolean functions 3|, U, |5|, [6( . Deterministic Boolean models 
often include an external process such as a clock that synchronizes all the updates or a device 
that selects a particular order of individual gate updates. The state space of such models 
is discrete and finite, and can therefore have only periodic attractors. On the other hand, 
in many physical or biological systems, information propagates between logic elements with 



tormation pr( 
link Q, H, E ] - 



time delays that can be different for each link [7|, [8|, |9[ • In such systems, the future behavior 
is determined by specification of the precise times at which transitions occurred in the past, 
which makes the state space continuous. The mathematics describing these autonomous 
Boolean systems is much less developed, though it is known that they can display aperiodic 
patterns if the logic elements have instantaneous response times 10, 



Ghil and collaborators 



11 



11 



128 . 



121 ] introduced Boolean delay equations (BDEs) to study 



Boolean networks of ideal logic elements. They study the dynamics of state transitions, 
(called events here) in the networks under the hypothesis that the logic gates can process 
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FIG. 1: (Color online) (a) Topology of the chaotic Boolean network and truth table for logic 
operation performed by the nodes 1, 2 (xor), and 3 (xnor) on their respective inputs, (b) 
Temporal evolution and (c) power spectral density (PSD) of the chaotic network for Vcc = 2.75 V 
with a measurement bandwidth of 1 MHz. 

input signals arbitrarily fast. They consider the behavior to be complex when the event rate 
per unit time for the whole system grows as a power-law, and predict it can happen for a 
wide class of Boolean networks. 

The complex behavior identified by Ghil leads to an ultraviolet catastrophe that can never 
occur in an experiment because real logic gates cannot process arbitrarily short pulses. We 
find that the predicted complex behavior is replaced by deterministic chaos in our exper- 
imental systems and numerical simulations that take into account the non-ideal behaviors 
described below. Given the presence of complex behavior in a large class of ideal BDEs, and 
given our observation of deterministic chaos in a simple experimental example with three 
nodes, we conjecture that a large class of experimental Boolean networks will display chaos. 

The topology of our autonomous Boolean network is shown in Fig. [T](a). It consists of 
three nodes that each have two inputs and one output that propagates to two different nodes. 
The time it takes a signal to propagate to node j from node i is denoted by r,-, (i, j = 1, 2, 3). 
Nodes 1 and 2 execute the Exclusive-OR (xor) logic operation, while node 3 executes the 
XNOR (see truth tables in the Fig. [T]). The three- node network has no stable fixed point and 



always leads to oscillations. Each time delay comes about from a combination of an intrinsic 
delay associated with each gate and the signal propagation time along the connecting link, 
which we augment by incorporating an even number of not gates or Schmitt triggers wired 
in series, either of which act effectively as a time-delay buffer. We stress that there is no 
clock in the system; the logic elements process input signals whenever they arrive, to the 
extent that they are able. 

We observe the dynamics of our network using a high-impedance active probe and an 
8-GHz-analog-bandwidth 40-GS/s oscilloscope. Figure [H(b) shows the typical observed be- 
havior when the probe is placed at the output of node 2. The temporal evolution of the 
voltage is complex and non-repeating and has clearly defined high and low values, indicating 
Boolean-like behavior. The rise time of the measured voltage is ~0.2 ns (close to the perfor- 
mance limit of the family of logic gates used in our circuit), and the minimum, typical, and 
maximum pulse widths in the chaotic time series are 0.2 ns, 2.4 ns, and 12 ns, respectively. 
In the frequency domain (Fig. [H(c)), the spectrum extends from dc to ~1.3 GHz (10-dB 
bandwidth). It is relatively flat up to 400 MHz and decays approximately as the inverse of 
the frequency from this point on. 

We find that the network dynamics depends on the supply voltage Vcc of the logic gates, 
which we consider as a bifurcation parameter. Our hypothesis is that the observed dynamics 
changes with supply voltage because the different characteristic times of the logic elements, 
such as the transition time delay, rise and fall times, etc., all depend smoothly on the supply 
voltage. To map out a bifurcation diagram for the network, we collect a l-/is-long time 
series of the voltage at node 2 for a fixed value of Vcc an d transform it into a time series of 
a Boolean variable x(t) e {0, 1} by comparison to a threshold: x(t) = 0, for V(t) < Vcc/2; 
x(t) = 1, for V(t) > Vcc/2 (dashed line in Fig. DJb)). We analyze the resulting Boolean 
time series to determine the time between successive transitions from low to high values and 
plot the observed transition intervals. We then increase Vcc by 5 mV and repeat, starting 
at Vcc = 0.9 V and ending at 3.3 V. 

As seen in Fig. [21 the bifurcation diagram shows regions of complex behavior, indicated 
by a nearly continuous band of points, interspersed by windows of periodic behavior. The 
fact that there exist several stable and robust periodic windows demonstrates that our device 
is not overly sensitive to noise in the voltage. Furthermore, complex behavior exists over 
a wide range of supply voltages, especially when Vcc > 2.40 V, where the logic gates are 



biased to operate at maximum speed. 




FIG. 2: Bifurcation diagram of the Boolean network. The arrow indicates the value of Vcc giving 
the complex behavior shown in Fig. QJb). 

A signature of chaos is exponential divergence of trajectories with nearly identical initial 
conditions, which is indicated by a positive Lyapunov exponent. We propose a method to 
estimate the largest Lyapunov exponent as follows. We acquire a long time series of the 
voltage and transform it to a Boolean variable x(t). Given any two segments of x(t) starting 



llj between them by 



at times t a and tb, we define a Boolean distance 

1 f s+T 

d(s) = -j x(t' + t a )@x{t' + t b )dt', (1) 

where T = 10 ns is a fixed parameter, © is the XOR operation, and the Boolean distance 
d(s) evolves as a function of the time s. We then search in x(t) for all the pairs t a and tb 
corresponding to the earliest times in each interval T over which d(0) < 0.01 (In d(0) < —4.6). 
Typically, 3,000 pairs of similar segments are found in a 40-/isdong time series. We then 
compute (lnd(s)), where ( ) denotes an average over all matching (t a ,tb) pairs. 

Figure [3](a) shows two typical segments for the voltages V(s + t a ) and V(s + t b ), and Fig. 
\3Hb) shows the associated Boolean variables x(s + t a ) and x(s + tb). A visual inspection of 
the time series on a much finer scale (not shown) reveals that there exist small differences 
in the timing of events between the two trajectories. On the scale of the figure, trajectory 
divergence is noticeable around 20 ns and the two trajectories appear to be uncorrelated 
after approximately 30 ns. 

To quantify these observations, we determine the largest Lyapunov exponent of the at- 
tractor. The solid black curve in Fig. [3](c) shows the time evolution of (ln<i). It displays an 
approximately constant slope for times shorter than ~20 ns and, finally, saturates at a max- 
imum value of In 0.5 ~ —0.69, corresponding to uncorrelated x(s + T + t a ) and x(s + T + tb). 
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FIG. 3: (Color online) (a) Typical segments of similar voltages for Vcc = 2.75 V. (b) The resulting 
Boolean variables obtained from the voltages in (a), (c) Logarithm of the Boolean distance as a 
function of time, averaged over the network phase-space attractor for experimental data (black) 
and simulations (red online). 

To estimate the value of the maximum Lyapunov exponent, we assume that, in the re- 
gion of constant slope, the divergence of the initially similar segments is exponential, i.e., 
lnd(s) = lndo + A a &s, where X a b is the local Lyapunov exponent. The average of X a b over all 
pairs of similar segments is our estimate of the largest Lyapunov exponent A of the system. 
We find A = 0.16 ns" 1 (±0.02 ns -1 ), which demonstrates that the network is chaotic. Our 
method is based on neighbor searching in the time series of a single element, as described 
in Ref . [l]] , except that we use the Boolean distance instead of delay-coordinates. 

To test our analysis method, we set Vcc to place the system in a nearby periodic window 
(2.35 V) and repeat our analysis. We find that the Boolean distance stays small ((IncZ) < 
—4), as expected. Furthermore, we verify that our signal is not generated by a hypothetical 
linear amplification of correlated noise by comparison between our experimental data and 
surrogate data, generated by shuffling the time series while preserving its power spectrum 
and distribution 131 ] . 



To better understand our observations, we study the Boolean delay equations 10, 111] 



Xi(t) = x 2 {t-r 12 ) ©£ 3 (t-Ti 3 ) 
x 2 (t) = x x (t - r 2 i) ® x 2 {t - t 22 ) 
xz{t) = Xi(t - r 3 i) © x 3 (t - r 33 ) 



(2) 



where Xi is the Boolean state of the i th node and the term ©1 performs the not oper- 



ation. The values of are given in the last line of Table [B Using initial conditions 
(xi(t) , X2{t) , x-s(t)) = (0,0,0) for t < 0, we find that the average event rate for x\(t) (or 
any of the variables) grows as a power law with exponent ~2, indicating complex network 



behavior as defined by Ghil et al. 



This increasingly fast event rate is prevented in the experimental system by the finite 
response time of the real logic gates. We find that the dominant contribution to the non-ideal 
behavior of the network components is due to the series of gates used to generate the delays 
in the network links; the non-ideal behavior of the XOR and XNOR nodes is much smaller and 
can be modeled by a constant delay after an ideal gate. To quantify the non-ideal behavior 
of the links, we measure simultaneously the voltage at the input and output of each link 
and determine the propagation delay times. The data display the three non-ideal behaviors: 
(1) short-pulse rejection, also known as pulse filtering, which prevents pulses shorter than 



a minimum duration from passing through the gate [7 



(2) asymmetry between the logic 



states, which makes the propagation delay time through the gate depend on whether the 
transition is a fall or a rise g|; and (3) a degradation effect that leads to a change in the 

n n 

propagation delay time of events when they happen in rapid succession |8|, H4|. We note that 



these non-ideal behaviors have been proposed for Boolean idealizations of electrical 14fl and 

nn 

biological networks [3, |8J , suggesting that studies of these effects may have wide application. 

The non-ideal behaviors are accounted for in our model as follows. First, following 
Ref. [lij], we introduce a new variable to describe the degradation effect of a link on signal 
propagation. Let t n be the time that event n occurs at the beginning of a link and let t' n be 
the time that the corresponding event is observed at the end of the link. Note that t n does 
not involve the degradation associated with the link, but t' n does. We define 

Pn =tri~\~ T ji — t n _ l , (3) 

where is the nominal time delay on the link for a rising (k = r) or falling (k = f) event. 
Typical behavior of the propagation delay T33 n = t n — t n for falling events as a function of 
P n for link 33 is shown in Fig. HI We fit the experimental data for all links to 

4, n = 4 + Ae~ BFn cos(fiP n , + 0) (4) 

where r^, A, B, Q, and <fi are fit parameters, and Tji >n is the delay of the n th event as it 
propagates through link ji. The minimum interval P m in is determined from the data based 
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TABLE I: Experimentally measured delay times rj^. 
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FIG. 4: (Color online) Experimentally measured time delay for a transition as it propagates through 
the delay line 33 (black dots) as a function of P n . Pulses are affected by the degradation effect. 
The measured values are fit to an empirical expression (solid line) discussed in the text. 

on the shortest value for which events are observed. The only parameter that depends 
strongly on the specific link and event sign is (see Table [I]). Based on our fit to the 
data in Fig. [4] (solid line), we find that the remaining parameters take on values A = 1.28 
ns, B = 1.4 ns -1 , Q = 4.8 rad/s, <fi = 0.062 rad, and P m in — 0.48 ns, which we assume 
applies to all links in our network. The next step in our simulation procedure is to solve the 
ideal Boolean delay equations ([2]) with Tji replaced by as appropriate. For each event, 
we evaluate P n . If P n < P m i n , both the new event and the previous one are eliminated. 
Otherwise, we adjust the newly generated transition time using Eq. (J4]). 

Using the simulated time series data, we calculate (lnci) (Fig. [3]^c)) using the initial 
value of the Boolean distance of d(0) < 0.001 (lnd(0) < —6.9) for choosing pairs. We 
find that A = 0.10 ns -1 (±0.02 ns -1 ), which demonstrates that the model, modified to 
take into account the non-ideal behaviors of the logic gates, displays deterministic chaos. 
Furthermore, the Lyapunov exponents obtained in both the experiment and simulations are 
very similar, demonstrating that our model captures the essential features of our electronic 
network. A systematic study of the effect of each individual non-ideal behavior is beyond 
the scope of this Letter. 

In summary, we observe that an autonomous Boolean network displays deterministic 
chaos in its sequence of switching times. This behavior is very different from that observed 




in Boolean networks with periodic or clocked updating, where only periodic behavior is 
predicted. Our research may have important implications for understanding other networks 
observed in nature. We note, for example, that chaos was observed in a system of differential 
equations of a form relevant to the modeling of genetic regulatory networks [8j, though 
the source of chaos was not identified. To make the connection to other natural systems 
precise, measurements of non-ideal logic elements are needed. We believe that the three 
effects identified here are likely to be generic, though they may be difficult to study directly. 
Further theoretical study is also needed to determine the extent to which modified Boolean 
delay equations can serve as a guide for designing and understanding real network behavior. 

RZ, HLDSC, ZG, DJG, and DPL gratefully acknowledge the financial support of the 
Office of Naval Research, grant Nos. N00014-07- 1-0734 and N00014-08-1-0871, and the advice 
of John Rodgers. JESS gratefully acknowledges the support of the NSF under grant PHY- 
0417372. HLDSC and RZ thank Steve Callender for tips on soldering techniques. 



t Electronic address: rzlO@phy.duke.edu 



* Electronic address: |hc71@phy.duke.edu 

[1 



[2] 
[3] 
[4] 
[5] 

[6] 
[7] 
[8 
[9 

[10 

[11 
[12 



A. R. Volkovskii, L. S. Tsimring, N. F. Rulkov, and I. Langmore, Chaos 15, 033101 (2005). 
I. Reidler, Y. Aviad, M. Rosenbluh, and I. Kanter, Phys. Rev. Lett. 103, 024102 (2009). 
F. Jacob and J. Monod, J. Mol. Biol. 3, 318 (1961). 

F. Jacob and J. Monod, Cold Spring Harb. Symp. Quant. Biol. 26, 193 (1961). 

E. H. Davidson, The Regulatory Genome: Gene Regulatory Networks in Development and 

Evolution (Academic Press, San Diego, California, 2006). 

A. Pomerance, E. Ott, M. Girvan, and W. Losert, Proc. Natl. Acad. Sci. 106, 8209 (2009). 

K. Klemm and S. Bornholdt, Phys. Rev. E 72, 055101(R) (2005). 

J. Norrell, B. Samuelsson, and J. E. S. Socolar, Phys. Rev. E 76, 046122 (2007). 

L. Glass, T. J. Perkins, J. Mason, H. T. Siegelmann, and R. Edwards, J. Stat. Phys. 121, 969 

(2005). 

D. Dee and M. Ghil, SIAM J. Appl. Math. 44, 111 (1984). 

M. Ghil and A. Mullhaupt, J. Stat. Phys. 41, 125 (1985). 

M. Ghil, I. Zaliapin, and B. Coluzzi, Physica D 237, 2967 (2008). 



[13] H. Kantz and T. Schreiber, Nonlinear Time Series Analysis (Cambridge Univ. Press, Cam- 
bridge, UK, 1997). 

[14] M. J. Bellido-Dfaz, J. Juan-Chico, A. J. Acosta, M. Valencia, and J. L. Huertas, IEE Proc. 
Circuits Devices Syst. 147, 107 (2000). 



